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SIGNIFICANCE  AND  EXPLANATION 


In  recent  years,  the  concept  of  tangent  cone  to  a  closed  convex  subset  K  of 
a  Hilbert  space  X  played  a  crucial  role  in  many  fields.  The  tangent  cone  TR(x) 
to  K  at  x  is  defined  as  the  closure  of  the  cone  spanned  by  K  -  x.  We  mention 
for  instance  the  Brouwer  -  Ky  Fan  theorem:  If  K  is  compact  and  convex  and  if  f 
is  a  continuous  map  from  K  to  X,  satisfying:  V  x  e  K,  f(x)  e  TR(x)  there  exists 
a  solution  xt  e  K  to  the  equation  f(x#)  =  0. 

Also,  the  Nagumo  theorem  states  that  under  the  same  assumptions,  for  all 
xQ  e  K,  there  exists  a  solution  x(0)  to  the  differential  equation  x'  =  f(x), 
x(0)  =  xQ  such  that,  V  t  >_  0,  x(t)  e  K. 

Finally,  if  V  is  a  real-valued  convex  differentiable  function  defined  on  a 
neighborhood  of  K,  then  xQ  achieves  the  minimum  of  V  on  K  if  and  only  if 

Vue  TR(x0) ,  <grad  V(xQ) ,  u>  •>  0  . 

These  three  typical  (and  fundamental)  results  motivate  a  systematic  study  of  tangent 
cones,  which  completes  the  study  of  the  contingent  cones  presented  in  Aubin  [5] .  We 
also  adapt  the  main  results  of  convex  analysis  to  set-valued  maps  (or  multi  functions) 
F  (associating  to  x  e  X  a  subset  F(x) ,  rather  than  to  a  point)  that  are  convex 
in  the  sense  that,  for  all  a  e  [0,1] , 

aF(x)  +  (l-a)F(y)  c  F(ax  +  (l-a)y) 


The  responsibility  for  the  wording  and  views  expressed  in  this  descriptive  summary 
lies  with  MRC,  and  not  with  the  author  of  this  report. 


DERIVATIVES  AND  CODIFFERENTIALS  OF  MAPS 
WITH  CLOSED  CONVEX  GRAPHS  AND  CONVEX  OPERATORS 

Jean-Pierre  Aubin 

Introduction 

When  K  is  a  closed  convex  subset  of  Hilbert  space  X,  the  contingent  cone  DK(x) 
to  K  at  x  e  K  coincides  with  the  tangent  cone  TR(x)  to  K  at  x<  defined  by 

T(x>  =  cU  U  i(K-x))  . 

K  h>0  h 

It  is  the  closure  of  the  convex  cone  S  (x)  defined  by 

K 

s„<x>  =  u  r<K-x> 

K  h>0  h 

spanned  by  K  -  x. 

Hence  TK<X)  is  ai”ays  a  convex  cone,  equal  to  X  when  x  e  Int(K) . 


We  always  have 

K  c  x  +  Tr<x) 

By  convention,  we  set 

T^(x)  =  0  . 
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The  first  result  states  that  when  K  is  closed  and  convex,  the  tangent  cone  Tj,(x) 

coincides  with  the  Bouligand  contingent  cone  D  (x)  =  n  u  (r  (K-x)  +  eB)  (see  Aubin 

h,a>0  he]0,a] 

[5],  for  instance).  But,  whereas  we  had  only  a  poor  calculus  on  contingent  cones,  consisting 
mostly  of  trivial  inclusions  or  inequalities,  the  convexity  of  K  allows  to  have  a  reasonable 
calculus,  where  equalities  hold. 

So,  Haddad's  theorem  (see  Haddad  [1])  states  that  the  property 

V  x  e  K,  F (x)  n  Tr(x)  t  9 

is  a  necessary  and  sufficient  condition  for  the  differential  inclusion  x' (t)  e  F(x(t))  to 
have  viable  trajectories,  i.e.,  trajectories  satisfying  x(t)  e  K  for  all  t.  We  also  know 
that  when  K  is  compact  and  convex,  this  condition  implies  the  existence  of  stationary  points 
x  e  K,  i.e.,  solutions  to  the  inclusion  0  e  F(x)  (see  for  instance  Aubin  [2],  chap.  15). 
These  two  results  only  motivate  a  further  study  of  these  tangent  cones. 

As  a  first  application,  we  complete  the  calculus  of  the  contingent  derivatives  of  a  set¬ 
valued  map  with  closed  graph;  when  xQ  belongs  to  the  domain  of  a  set-valued  map  F  and 
yQ  e  F (xq )  »  we  recall  that  the  graph  of  the  contingent  derivative  D F(xQ,yQ)  is  the  contin¬ 
gent  cone  to  its  graph  at  (x0,yQ) ,  which,  in  this  case,  is  a  closed  convex  cone.  Such  maps 

are  called  "convex  processes" ;  they  are  the  set-valued  analogues  of  continuous  linear  maps 
(which  are  the  single  valued  convex  processes).  In  particular,  they  posses  "transposes". 
Actually,  the  transpose  of  a  contingent  derivative,  which  we  shall  call  a  codifferential, 
enjoys  "nicer"  properties  than  the  contingent  derivative  itself. 

Let  P  be  a  closed  convex  cone  of  a  Hilbert  space  Y,  representing  the  set  of  "non¬ 
negative  elements  of  Y".  A  convex  operator  A  from  X  to  Y  is  a  single  valued  map  defined 
on  its  domain  D (A)  c  x  to  Y  that  satisfies  V  x,  y  e  D (A) ,  V  6  e  (0,1], 

9A(x)  +  ( 1—0 ) A ( y )  t  A(0x  +  ( 1—0 ) y )  +  P.  Since  A  is  convex  if  and  only  if  the  associated  set 
valued  map  A+  defined  by  A+(x)  =  A(x)  +  P  has  a  convex  graph,  we  are  able  to  define  "upper 
derivatives  and  codifferentials"  of  a  convex  operator  via  the  derivatives  and  codifferentials 
of  the  set-valued  map  A+ .  When  Y  =  ]R+  ,  convex  operators  are  convex  functions  and  we 
derive  the  main  results  of  convex  analysis  (see  for  instance  Rockafellar  (1],  [2]). 


Since  the  tangent  cone  T^tx)  is  a  closed  convex  cone,  it  is  quite  useful  to  introduce 

the  (negative)  polar  cone  of  a  tangent  cone:  this  is  the  normal  cone  to  K  at  x,  denoted 

by  N  (x)  ,  which  coincides  with  the  subdifferential  3ifi  (x)  of  the  indicator  of  K  at  x: 

K  K 

N  (x)  =  {p  e  X  |  <p,x>  =  max  <p,y>}  . 

K  y«X 

When  X  is  finite  dimensional,  we  shall  prove  that  the  set  valued  map  x  TK<x)  is  lower 
semicontinuous,  that  the  graph  of  x  >-*  N^fx)  is  closed  and,  when  Int  K  ?  9,  that  the  graph 

of  x  *-►  Int  T  (x)  =  u  h  *Int  K  "  is  °Pen-  Finally,  we  provide  several  formulas.  If 

h>0  " 

K  =  B,  is  the  unit  ball,  then 

if  || x ||  =  1,  Tg(x)  =  {x} 


When  K  is  a  closed  convex  cone,  then; 


v  £  TR(x)  if  and  only  if  V  p  £  K  satisfying  <p.x>  =  0  , 


we  have  <p,v>  <  0 


When  K  =  K+  is  the  positive  orthant,  this  formula  becomes: 


v  e  T  (x)  if  and  only  if  v.  >  0  whenever  x.  =  0 
Rn 


If 


K  =  Mn  =  (x  !  l”  I  J  x.  =  1},  we  obtain 
+  '  U  1 


v  £  T  (x)  if  and  only  if  7  v.  =  0  and  v.  >  0  whenever  x.  =  0 

„n  i  1  1  ~  i 

M  1=1 


When  A  £  f (X,Y)  and  y  £  Y  are  given,  we  check  that  if  Ax  =  y  , 


T  (x)  =  Ker  A 

A_i(y) 


We  shall  prove  also  the  following  formulas: 


n  T„  (x  ) 


T 


(x. , . . , x  ) 


If  L  <=  X  and  M  c  y  are  closed  convex  subsets  satisfying  the  condition  0  e  Int(A(L)  -  M)  , 
then  if  x  e  L  n  A  1 (M) , 

T  ,  (x)  =  T  (x)  n  A_1(T  (Ax))  . 

LnA_1(M>  L  M 

The  latter  formula  will  play  a  very  important  role  in  applications.  In  particular,  if  L  c  X, 

M  c  x  satisfy  0  e  Int(L-M) ,  than  we  obtain 

Tt  (x)  =  Tt  (x)  n  T  (x) 

LnM  L  M 

We  consider  then  the  contingent  derivative  DF(xQ,y0)  of  a  map  F  from  X  to  Y  with  closed 

• f 

convex  graph:  its  graph  is  a  closed  convex  cone;  A  map  whose  graph  is  a  closed  convex  cone 
is  called  a  "convex  process".  These  maps  are  the  set-valued  analogues  of  continuous  linear 
operators  (which  are  single  valued  convex  processes) .  One  can  hope  that  the  contingent  deriva¬ 
tives  of  a  map  with  closed  convex  graph,  inheriting  the  properties  of  tangent  cones  to  closed 

convex  subsets,  enjoy  a  "nice"  calculus.  This  is  not  exactly  the  situation. 

* 

Fortunately,  we  can  define  the  transpose  G  of  a  convex  process  G  from  X  to  Y, 

*  *  * 

which  is  a  convex  process  from  Y  to  X  .  It  happens  that  it  is  the  transpose  DF(xQ,y0) 

of  the  contingent  derivative  DF(x0>y0)  that  benefits  of  most  of  the  expected  properties. 

We  call  it  the  codifferential  of  F  at  (xQ,y0). 

Also,  the  graph  of  F  is  characterized  by  its  support  function,  which,  up  to  a  minus 
sign,  is  equal  to 

* 

f  (p»q)  =  sup  sup  [<p,x>  -  <q,y>]  . 

xcX  yeF(x) 

This  function  shall  play  a  quite  important  role.  We  call  it  the  conjugate  function  of  F. 

Actually,  these  concepts  are  consistent  with  the  familiar  concepts  of  convex  analysis. 

If  V  is  a  lower  semicontinuous  convex  function  from  K  c  x  to  K  .  The  set-valued  map 
V+  from  K  to  K  defined  by 


V+(x)  i  V(X)  +  »+ 


has  a  closed  convex  graph. 

He  shall  see  that 

DV+(x,V(x) ) (u)  =  [D+V(x)  (u)  ,°°[ 

where 


D+V(x)  (u) 


......  V(x+hv)  -  V(x) 

lim  inf  inf  - - - 

,  ^  h 

v-Hi  h>0 


that/  if  q  =  1  £  R(=Y  )  , 


V  p  £  X*, 


(V+)*(p,l)  =  V*(p) 


defines  the  conjugate  function  of  V  and  that 

DV+(x,V(x))*(l)  =  3V(x) 


is  the  subdifferential  of  V  at  x. 

So,  the  duality  between  directional  derivative  D+V(x)  and  subdifferentials  3V(x)  is 
preserved  in  the  general  framework. 

By  the  way,  we  shall  define  "convex  operators"  A  from  X  to  a  Hilbert  space  ordered  by 
a  closed  convex  cone  P  to  be  the  single  valued  maps  satisfying,  for  all  a  £  [0,1], 


aA(x)  +  (l-o)A(y)  £  A(ax  +  (l-a)y)  +  P  . 

Since  the  graph  of  the  set-valued  map  A+  defined  by 

A+(x)  =  A(x)  +  P 

is  convex,  these  maps  will  enjoy  the  properties  of  the  set-valued  maps  with  closed  convex 
graph  which  we  are  about  to  summarize. 

* 

We  begin  with  the  following  characterizations  of  the  codifferential  DF (xqYq)  !  the 
statements  below  are  equivalent: 
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a) .  P0  *  DF(x0,yQ)*(q0) 

b)  .  V  x  £  X,  V  y  £  F(x),  ±  <P0,xQ-x> 

c) -  <P0-x0>  =  f*(P0.q0)  +  <q0.yQ> 

d)  .  V  u  £  X,  V  v  £  DF(xQ,y0)  (u)  ,  (pQ,v>  <_  (qg.u)  • 

The  variational  principle  holds:  When  P  c  y  is  a  closed  convex  cone,  then 
<x  ,y  )  £  graph  (F)  achieves  the  minimum  of  F  in  the  sense  that 


if  and  only  if 


V  x  s  X,  F (x)  c  yQ  +  p 


V  u  «  X,  DF(xQ,y0) (u)  c  p  . 

The  expected  formulas  hold. 

a)  If  A  e  £  (Z,X)  and  if  0  £  Int  (Im  A  -  Dom  F) ,  then  the  chain  rule 

D(FA) (z0,yQ)*  =  A*DF(Az0,yQ)* 

\ 

holds. 

b)  If  A  £  JC  (Y,X)  and  if  AF  denotes  the  map  whose  graph  is  the  closure  of  the  graph 

of  AF,  then 

D(AF) (xQ,Ay0) *  =  DF(x0,y0>*A*  . 


c) 


If  F  is  an  upper  hemicontinuous  map  with  compact  values  and  convex  graph,  if  F2 
is  a  map  with  closed  convex  graph  and  if 

0  £  Int  (Dom  F^  -  Dom  F2> 


then 


d) 


D (Fj.  +  f2>  1 V  yl  +  y2)*  =  DFl(X0'yl>*  +  DF2<X0'y2)4  * 

Let  K  be  a  subset  of  X  and  f|  denote  the  restriction  of  F  to  K. 
0  £  Int  (K  -  Dom  F) ,  then 


If 


t 
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1.  Tangent  cones . 
Definition  1 


Let  K  c  X  be  a  closed  convex  subset  and  x  e  K.  We  denote  by 

(1)  S  (x)  ±  U  i  (K-x) 

K  h>0  h 

the  cone  spanned  by  K-x  and  by 

(2)  T  (x)  =  cl(  U  ^  (K-x)) 

K  h>0  h 

its  closure.  Tk(x)  is  called  the  "tangent  cone  to  K  at  x".  First,  we  note  that 

v  e  SR(x)  if  and  only  if  x  +  hv  e  K  for  some  h  >  0  and  that  v  €  TK(x)  if  and  only  if 

there  exist  a  sequence  of  elements  converging  to  v  and  positive  h^  such  that 

x  +  h  v  e  k  for  all  n  >  0. 
n  n 

Also,  i£  v  c  SR(x)  and  thus,  if  x  +  hv  6  K  where  h  ^  0,  then,  for  all  k  e  [0,h] 

Jc  k 

x  +  kv  e  K:  Indeed,  x  +  kv  =  (1  -  — )x  +  —  (x  +  hv)  is  a  convex  combination  of  elements 

h  h 

belonging  to  the  convex  set  K. 

Also,  the  cone  S^(v)  is  obviously  convex:  Indeed,  if  v^  and  v2  belong  to  SR(V) 
then  x  +  hjVj^  £  K  for  i  =  1,2;  let  h  =  minfh^hj).  Then,  by  the  preceding  remark, 

x  +  hv^  £  K  for  i  =  1,2.  Hence  x  +  hfav.^  +  (l-a)v2)  £  K  when  a  £  [0,11.  Since  the 
closure  of  a  convex  cone  is  still  a  convex  cone,  we  have  proved  the  following  proposition. 
Proposition  1 

The  cones  S^tx)  and  T^,  (x)  are  convex.  A 

It  is  also  clear  that 

(3)  K  c  x  +  SR(x)  c  x  +  Tk(x) 
and  that 

(4)  if  x  «  Int  K,  then  TR(x)  “  x 

since  K-x  contains  a  neighborhood  of  the  origin. 

The  first  property  is  that  the  tangent  cone  T„(x)  coincides  with  the  contingent  cone 

K 


Dk(x),  defined  by 


(5)  D„ (x)  =  n  V  (-  <K-x)  +  EB)  . 

£,a>0  h£]0,a] 

(See  Aubin  15],  for  instance.)  It  is  obvious  that  we  always  have 

Dr(x)  c  tk(x) 

Theorem  X 

When  K  is  closed  and  convex,  then 

(6)  V  x  £  K,  Tr(x)  =  Dr(x)  . 

Proof: 

Let  v  e  T  (x) =  ci(S  (x) ) .  Then,  for  all  £  >  0,  there  exist  y£  £  K  and  h£  >  0  such 
K  K 

that 

v  -  —  (y  -  x)  c  eB 
h£  E 

i.e.,  such  that  x  +  h£V£  £  K  where  v£  =  ^  (y£  -  x) . 

Let  us  associate  with  any  a  >  0  the  positive  number  h  =  min(a,h£)  >  0.  Since _ K _ 

y  *>*  x) 

convex,  x  +  ht-^-r - )  =  (1  -  £-)x  +  ^(x  +  h  v  J  belongs  to  K.  This  proves  that  for  any 

-  n  h  n  ee 

e  e  e 

£  >  0  and  a  >  0,  there  exist  h  <_  a  and  v£  £  v  +  £B  such  that  x  +  hv£  e  K,  i.e.  that 
v  £  DR(x) . 
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2.  Normal  cones 


We  recall  the  definition  of  normal  cones  to  a  closed  convex  subset 


Definition  1 


Let  K  be  a  nonempty  closed  convex  subset  of  X.  The  "normal  cone"  N  (x)  to  K  at 


w  - 

N  (x)  =  {p  e  X  such  that  <p,x>  =  max{(p,y>  |  y  e  K) 


The  normal  cone  N  (x)  is  the  (negative)  polar  cone  T  (x)  of  the  tangent  cone  T  (x) 


Therefore,  T  (x)  =  N  (x)  since  T  (x)  is  a  closed  convex  cone 


then 


when 


We  also  recall  the  following  property 


The  normal  cone  N  (x)  is  the  subdifferential 


K.  Then  it, 


Since  TK<X>  is  convex,  it  is  the  closure  of  its  interior.  Hence  formula  (2) 
holds  true . 

b)  Let  v  (  Int  T  C x_ ) .  Therefore,  v.  e  77-  (Int  K  -  x.)  for  some  h.  >  0;  hence 
u  R.  U  U  Hq  o  u 

there  exists  e  >  0  such  that  x.  +  h.v„  +  EB  =  x.  +  h„(v„  +  r~  B)  c  Int  K.  Take 

U  U  U  U  U  0  rig 

x  e  xQ  +  e/2B  and  v  £  vQ  +  c/2h0B.  Then  x  +  hQv  £  xQ  +  hQv0  +  EB  c  int  K  and 

therefore,  v  £  Int  T  (x) .  Hence  the  graph  of  x  -*•  Int  T„(x)  is  open.  • 

K 
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4.  Tangent  cones  to  some  closed  convex  sets 


Let  B  be  the  unit  ball  of  a  Hilbert  space  and  x  £  B  .  Then 


i)  T_  (x)  =  X  if  x  £  Int  B  and  T_(x)  =  {x}“  if  ||x||  =  1  . 

B  B 

ii)  N  (x)  =  {0}  if  x  e  Int  B  and  N  (x)  =  H  x  if  ||x|[  =  1 
B  D  + 


Proof :  We  take  ||  x  ||  *  1 . 

Then  p  £  N  (x)  if  and  only  if  l|p||*  =  sup  <p,y>  =  <p,x).  By  the  Cauchy-Schwarz 
B  yeB 

inequality,  this  is  equivalent  to  p  =  Xx  with  X  >  0. 

By  polarity,  we  deduce  the  formula  for  the  tangent  cone. 

Proposition  2 

Let  K  c  x  be  a  closed  convex  cone.  Then  NR(x)  =  K  r){x}J'  and  thus; 


v  e  Tk(x)  and  °niy  if  (p»v>  £  0  for  all  p  e  K  satisfying 

<p,x>  =  0  . 


If  K  is  a  closed  subspace,  then  TR(X)  =  K  and  NK<X)  =  K 


It  is  clear  that  K_  n  (x)1  is  contained  in  NR(x) .  Conversely,  if  p  e  NR(x) ,  then 

<p,x>  =  max  (p,y>.  Since  K  is  a  cone,  we  deduce  that  (p,x>  =  0  and  that  p  e  K  .  • 

ycK 

Proposition  3 

Let  A  £  £ (X , Y)  and  K  =  A  1 (y)  be  an  affine  subspace.  Then,  if  Ax  =  y, 

(3)  T  (x)  =  Ker  A  . 

a*  (y) 

Proof :  a)  If  v  £  Ker  A,  then  v  +  xtA^y)  =  K  and  thus,  v  =  v  +  x  -  x  belongs  to 

Vx> . 

b)  Conversely,  if  v  =  lim  v  e  T„(x),  where  v  =  X  (x  -  x)  with  x  £  K  and 

n  K  n  n  n  n 

n-*<» 

X  >0,  then  v  £  Ker  A  and  thus  v  £  Ker  A.  • 

n  n 

Proposition  4 


Let  Mn  =  {x  e  |  1  x.  ■  1).  Let  I(x)  {i=l,..,n  |  x.  =0}.  Then 

i=l  1 


(4) 

and 


v  e  T  (x)  if  and  only  if  v.  >  0  for  all  i  e  I (x) 
.sn  1  — 


K 


(5) 


veT  (x)  if  and  only  if  v.  >_  0  for  all  i  e  I(x) 
Mn  1 


and  1  v.  =  0 
i=l  1 


Proof:  a)  If  K  =  R+  ,  the  first  statement  follows  from  Proposition  3: 

n 

If  p  e  3?  satisfies  T  p.x.  =  V  p.x.  =  0,  then  p.  =  0  whenever 

i  i  .1,,  .1  i  l 

i=l  ijl(x) 

i  $  I(x);  hence  v  e  T  ^  (x)  if  £  pivi  —  0  for  P  £  '  i-e.»  if 


iel(x) 


and  only  if  (4)  holds. 


n 

b)  Let  v  satisfy  vi  >_  0  if  i  e  I(x)  and  J  vi  =  0.  If  =  0  for  all 

i=l 


i  |  I(x)  ,  then  v  =  0.  If  not,  let  X  =  min  >  0.  Therefore  x  +  Av  £  Mn 

i4i(*)  |vil 

vi=0 

since  x  +  Av  =  A  v  >0  if  i  e  I(x),  x.  +  Xv.  >  x.  -  X|v.|  >  x.  -  x  =  0  if 

1  1^11—  1  1—1  1  —  1  1 

i  ^  I(x)  and  £  <x  +  Xv.)  =  1  +  0  =  1.  Hence  v  <r  ^  (Mn  -  x)  e  T  (x)  . 

i=l  A  Mn 


c)  If  v  =  A(y-x)  where  y  e  M  and  A  >  0,  then  we  deduce  that 

n 

v-  »  A(y.  “X.)  «  Ay.  >0  when  i  e  I(x)  and  that  T  v.  =  0.  Therefore 
1  i  l  i  —  .  *•,  i 

n  n  1 

u  MM  -  x)  c  {v  «  T  (x)  |  £  v.}  =  0.  Since  the  latter  subset  is  closed. 


A>0  r"  ’  i=l  1 


n 


we  deduce  that  T  (x)  =  {v  e  T  (x)  I  Y  v.  =  0}. 

Mn  b"  i-1  1 


-14- 


/ 


5.  Calculus  on  tangent  cones  to  closed  convex  subsets 


Proposition  3 


Let  A  e  £(x,Y)  and  K  c  x.  Then, 

(5)  V  X  £  K,  T _  (Ax)  =  cl  (AT  (x) ) 

A(K) 

and,  by  polarity, 

(6)  N _  (x)  =  A*_1(Nv(x))  .  * 

A  (K) 

Proof: 

*  * 

Since  <p,  Ax >  =  max  <p,  Ay>  =  max  (A  p,  y>  =  <A  p,  x>,  we  obtain  the  formula  for  the 
yeK  yeK 

normal  cones  and  deduce  it  by  polarity  for  tangent  cones.  ■ 

Corollary  1 

Let  K  and  L  be  two  closed  convex  subsets,  x  £  K  and  y  £  L.  Then 

(7)  T _ (x+y)  =  cf(T  (x)  +  T  (y) )  and  N _  (x+y)  «  N„(x)  n  NT  (y)  .  * 

K+L  K  L  K^L  K  L 

Theorem  1 

Let  A  £  JC  (X,Y)  ,  L  C  x  and  M  c  y.  He  set 

(8)  K  Mx  £  L  |  Ax  £  M)  *  L  (1  A'1(M). 

Assume  that  K  ^  0,  i.e.,  that  0  £  A(L)  -  M.  The  inclusion 

(9)  T  (x)  C  T  (x)  n  a”1  (T  (Ax)  ) 

fc.  Li  M 

is  always  true.  If  we  assume  that 

(10)  0  £  lnt(A(L)  -  M)  , 
then  the  equality 

(11)  Tk(x)  =  Tl(x)  n  A-1(Tm<Ax)) 

holds  true.  a 

Proof: 

The  first  inclusion  is  obvious.  The  equality  shall  follow  from  the  Robinson  -  Ursescu 
theorem.  (See  Robinson  (1), Ursescu  [1].)  Let  x.  £  K  and  v„  e  T. (x„)  n  A-1T„(Ax.) .  There 

U  0  L  U  MO 

-16- 


exist  sequences  of  elements  v^  e  X  and  u^  e  Y  converging  to  and  fiv^  respectively 

1  2  12 
such  that,  for  all  n,  x  +  h  v  £  L  and  Ax„  +  h  u  £  M.  We  set  h  £  min(h  ,h  ,1)  >0. 

Onn  Onn  n  n  n 

Since  L  and  M  are  convex ,  we  deduce  that 

(12)  for  all  n,  x  £  x.  +  h  v  e  L  and  v  £  Ax„  +  h  u  t  M. 

nOnn  •'n  Onn 


The  theorem  is  proved  if  u^  =  Av^  for  an  infinite  subset  of  indexes.  If  not,  we  apply  the 
Robinson  -Ursescu  theorem  to  the  set-valued  map  F  defined  from  L  to  Y  by 

(13)  F(x)  £  Ax  £  M  . 

We  take  yQ  =  0  and  xQ  £  F~1(0)  =  K.  By  assumption  (10),  yQ  £  Int  F(L)  =  Int(A(L)  -  K)  . 
Hence,  there  exists  y  >  0  such  that 

(14)  V  x  €  L,  d (x,  F_1  (y) )  _<  ^  d(y,  F(x) )  ( ||xQ  -  x||  +  1)  . 

We  take  y  =  0  and  x  =  xQ  +  h^.  So  || xQ  -  x||  =  hn||v0|| ,  d(0,  F(xQ  +  h^) )  = 

d(Ax0  +  hnAv0'  M)  -  d(Ax0  +  hnun'  M)  +  hJIAV0  "  UJI  =  hJIAv0  "  UJI  •  Therefore< 


(15) 


d(x0  +  W  K)  1 


h  =iTd(x0  +  hnV0'  F'1(V>  i7ird(0'  F(X0  +  hnV)(HX  -  XoH  +  11 


-y  HAV0  *  Unll(hJIVoH  +  X)  • 


Hence 

(16) 


inf 

h  >0 
n 


d(X0  +  hnV0'K) 


0  . 


This  means  that  vQ  e  tk<xq) • 

By  polarity,  we  deduce  that  assumption  (10)  implies 

(17)  N  (x)  =  cUN  <x)  +  A*N  (Ax))  . 

K.  L  M 

It  also  implies  that  N^fx)  +  A  (Ax)  is  closed.  Actually,  it  implies  that  the  map 

(18)  (p»q)  €  N  (X)  x  N„(Ax)  »■  p  +  A*q  £  X* 
is  "proper" .  This  means  that 
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Indeed,  there  exist  A  >  0,  y  e  L  and  z  e  M  such  that  v  =  A(z-Ay)  by  assumption  (20) . 
Hence 

<qn,v>  =  ><qn»  z  -  Ay)  =  A((qn,z)  -  <A  qn<y>) 

=  M<Pn>y>  +  <qn-z>  -  <rn.y>) 

i  (<Pn-x>  +  <qn,Ax>  -  <rn,y>) 

(since  p  e  N  (x)  and  q  e  N..(Ax)) 
n  L  n  M 

-  A<rn,  x  -  y>  <  A||rn||  ||x  -  y||  <  +» 


since  the  converging  sequence  r^  is  bounded. 

By  the  uniform  boundedness  theorem  (see  Aubin  12],  chap.  4,  §1,  p.  73  for  instance)  the 
sequence  of  elements  q^  is  bounded.  Therefore,  it  is  weakly  relatively  compact  and  thus. 
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Then 


(29) 


V  x  e  K,  TK(x)  =  O  T  (x)  . 

i=0  i 


Proof : 


We  consider  the  map  A  defined  from  Xn+*  to  Xn  by 


(30) 


A(x  ,x, , . . . ,x  )  =  (x„  -x,,  x„  -  x„,...,x„  -  X  ) 
01  n  0102  On 


We  set  L  =  KQ  x  x»”x  Kn  c  xn+1  and  M  =  {0}.  So  K  =  L  n  A_1(M).  Assumption  (28) 

-V 

amounts  to  saying  that  0  e  Int(A(L)  -  M) .  Therefore,  when  x  e  K  and  when  x  =  (x,...,x)  £  L, 
n 

then  T  (x)  =  II  T  (x)  and  T„(0)  =  0.  So  v  e  T„(x)  if  and  only  if  v.  e  T„  (x)  for  all 

i=0  l  i 

i  =  0,...,n  and  v_  -  v,  =  0,...,v_  -  v  =0  (i=l,...,n).  This  means  that 
0  1  On 


vo  £  "  tk.(x)' 
1=0  1 


6.  Derivatives  and  codifferentials  of  set  valued  maps  with  closed  convex  graph. 


We  shall  complete  the  analysis  of  the  properties  of  contingent  derivatives  in  the  case 

when  the  set  valued  map  F  from  X  to  Y  has  a  closed  convex  graph. 

Recall  that  the  graph  of  F  is  convex  if  and  only  if  for  any  convex  combination 
n 

y  Ax.  of  elements  x.  e  X,  we  have 
.  .  i  i 

1*1 

n  n 

l  AXF(x.)  cf(  J  AXx.)  . 
i=l  1  i=l  1 

We  shall  see  that  convex  functions  and,  more  generally,  convex  operators  yield  examples  of 
set-valued  maps  with  convex  graph. 

We  also  recall  that  upper  hemicontinuous  set-valued  maps  from  X  to  the  closed  convex 
subsets  of  Y  have  a  closed  graph. 

Contingent  derivatives  of  set-valued  maps  with  closed  convex  graphs  enjoy  the  properties 
of  tangent  cones  to  closed  convex  subsets. 

Proposition  1 

Let  F  be  a  proper  set-valued  map  from  K  c  x  to  Y.  Then  the  contingent  derivatives 

DF(x,y)  are  convex  processes,  i.e.,  set-valued  maps  whose  graphs  are  closed  convex  cones. 

a 

Proof ; 

Indeed,  the  graph  of  DF(x,y) ,  being  the  contingent  cone  to  the  graph  of  F  at  (x,y) , 

is  actually  the  tangent  cone  T  ,  (x,y),  which  is  convex.  ■ 

graph  IF; 

Since  Dgraph(p)  =  Tgraph (F)  '  the  formula  °f  the  contingent  derivative  may  be 

simplified.  We  obtain: 

F(xq  +  hu)  -  yQ 

(1)  vQ  £  DF(x0,yQ)  (uQ)  «**  lim  inf  lim  d(vQ,  - - - )  =  0  . 

u*uQ  h-K)+ 


If  F 
(2) 


is  locally  Lipschitzean,  we  obtain 

F(x0  +  hV  ‘  yo 

vo  £  DF(*0-y0)(uo)  ~  lim  d(V - h - '> 

h-K)+ 


0  . 
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Definition  1 


For  simplicity,  when  the  graph  of  F  is  closed  and  convex,  we  shall  say  that  DF(x0,yQ) 
is  the  "derivative"  of  F  at  (x0,yQ) .  * 


The  convexity  of  the  graph  of  F  implies  that  for  all  y  e  F(x),  when  hj^  £  h2'  then 


F(x  +  h2u)  -  y  Fix  +  h^u)  -  y 


Indeed,  for  all  y  e  Fix),  we  can  write 


h  h  h  h 

—  Fix  +  h_v)  +  (1  -  — )y  C  F (r —  (x  +  h.v)  +  (1  -  — )x)  =  F(x  +  h,v)  .  This  amounts  to  saying 

h2  2  h2  h2  2  h2  1 

that  the  function  8  h-  d(v,  is  increasing.  So,  we  can  write 

Fix  +  hu)  -  y  Fix  +  hu)  -  y 

(3)  lim  d(v  ,  - r -  =  inf  d(v  ,  - r - ) 

h-*0+  Oh  h>0  °  h 

We  recall  that 

DF(x0,y0)_1  =  D(F_1) (y0,xQ)  for  all  xQ  e  K,  yQ  e  F(xQ)  . 


Let  y^  «  F(Xq).  Since  the  images  Fix)  are  closed  and  convex,  we  can  form  the 
differential  quotients 

<4)  h  (lIF(x0  +  huQ)yO  -  y0>  ‘ 

If  the  limit  when  h  -*•  0+  of  these  differential  quotients  does  exist,  we  shall  say  that  F 
has  a  directional  derivative  at  (xq'Yq)  in  the  direction  uQ.  We  shall  set 

(5)  VF(x0'y0)(U0)  =  h  <TF(xn  +  hu  ) y0  -  V  • 

h-*0+  0  0 

It  is  obvious  that  in  this  case 


7F(Vy0)(V  £  DF(xo'yo)(uo) 


It  is  clear  that 


V(xQ,y0)  £  graph (F)  ,  Tr(j{  j  (yQ)  c  DF(x0,y0)(0)  . 
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Consequently,  since  the  graph  of  DF(x  ,y  )  is  a  convex  cone,  we  have 


DF(VV  (U0>  +  TF(x0)<yo’  C  DF<X0'y0)<U0> 


In  particular,  if  F  has  a  directional  derivative,  we  have 


VF(x0'y0)<U0)  +  TF(x0)(yO)  C  DP,X0’yO)(U0) 


If  F  is  locally  Lipschitzean,  we  obtain  the  equality 


^(x/V  =  DF(x0'y0)  (0) 


Proposition  2 


Let  xQ  and  x  belong  to  the  domain  of  a  set  valued  map  F  with  closed  convex  graph. 
For  any  yQ  e  F(xQ),  we  have 

(11)  F (x)  -  yQ  c  DF(xQ,y0) (x-xQ)  .  * 


Indeed,  for  any  h  e  ] 0 , 1 ] ,  for  any  y  e  F(x) ,  we  have  (l-h)y0  +  hy  c  F(xQ  +  h(x-xQ)). 
F(x0  +  h (x-Xg) )  -  yQ 

Hence  y  -  yQ  e  - - - .  This  implies  that  y  -  yQ  e  DF(xQ,y0) (x-xQ) .  ■ 

This  inclusion  allows  a  characterization  of  the  minimum  of  a  set-valued  map  (variational 
principle) . 

Let  P  c  y  be  a  closed  convex  cone  of  Y  defining  a  preorder.  We  recall  that  xQ  e  K 
achieves  the  minimum  of  set-valued  map  F  :  K  -*•  Y  at  y^  e  Ffx^)  if 

(12)  V  x  e  K,  F  (x)  c  yQ  +  P  . 

Proposition  3 

Let  F  be  a  set-valued  map  from  K  to  Y  with  closed  convex  graph.  Then  xQ  e  K 

achieves  the  minimum  of  F  on  K  at  y^  e  F(Xg)  if  and  only  if 

(13)  V  uQ  e  X,  DF(xQ,y0) (uQ)  c  P  . 
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Proof : 


The  necessity  is  always  true  (see  Proposition  4.9  of  Aubin  [5]).  Let  x  €  K.  By  Proposi¬ 
tion  2,  property  (13)  implies 

F(x)  e  yQ  +  DF(x0,yQ) (x-xQ)  C  yQ  +  P  .  ■ 

Let  us  recall  the  definition  of  a  convex  process  G  from  X  to  Y  and  of  its  transpose. 
Definition  2 

A  set-valued  map  G  from  X  to  Y  is  called  a  convex  process  if  and  only  if  its  graph 

*  *  # 

is  a  "closed  convex  cone".  Its  transpose  is  the  convex  process  G  from  Y  to  X  defined 
by 

(14)  p  €  G*  (q)  *“*  V  X  £  X,  V  y  £  G(x),  <p,x>  <_  <q,y> 
or,  equivalently, 

(15)  p  £  G  (q)  if  and  only  if  (p,-q)  £  (graph(G)J  .  4 

** 

It  is  clear  that  the  bitranspose  G  of  a  convex  process  G  is  equal  to  G.  Convex 
processes  are  the  set-valued  analogues  of  continuous  linear  operators,  whose  graphs  are  closed 
subspaces  of  X  *  Y.  If  G  £  X(x,Y) ,  the  transpose  of  G  (regarded  as  a  convex  process) 
coincides  with  the  transpose  of  G  (regarded  as  a  continuous  linear  operator) . 

We  shall  single  out  the  transpose  of  DF(x0»y0) ,  which  is  a  convex  process. 

Definition  3 

* 

We  shall  say  that  the  transpose  DF(xQ,y0)  of  the  contingent  derivative  DF(x0,yQ)  of 
a  map  F  with  closed  convex  graph  is  the  "codifferential"  of  F  at  (X0'Y0* •  * 

•  *  * 

It  is  a  convex  process  from  Y  to  X  that  associates  with  any  qQ  £  Y  a  (possibly 

empty)  closed  convex  subset  DF<*0'y0>  *  (Sq)  of  x*  •  So,  pQ  £  DF(xQ,y0)  *  (q^  if  and  only  if 

(16)  V  u  £  X,  V  V  £  DF(XQ,yo)  (U)  ,  (P0.U)  <  <q0,v>  . 

Since  the  graph  of  F  is  closed  and  convex,  we  can  characterize  the  codifferential  in  the 
following  way. 
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Proposition  4 


Let  F  be  a  set-valued  map  from  X  to  Y  with  closed  convex  graph.  The  following 
statements  are  equivalent. 

a) .  pQ  £  DF(x0,y0)*(q0) 

b)  .  V  x  e  X,  V  y  £  F(x),  (qQ.yg-y)  <  <P0'X0_X>  . 

Proof : 

We  use  the  facts  that  the  graph  of  DF(xQ,y0)  is  the  tangent  cone  to  graph (F)  at 

U  ,y  >  and  that  its  negative  polar  cone  is  the  normal  cone  to  graph (F)  at  (xQ ,yQ)  (see 

* 

Proposition  2.1  above  ).  Hence  pQ  £  DF(x0,y0)  (qQ)  if  and  only  if  (pQ,-q0)  e 
Ngraph (F)  ^X0'y0^  *  Th*s  is  exactly  the  second  statement  of  the  proposition.  ■ 

The  following  property  of  monocity  holds: 

Proposition  5 

Let  F  be  a  set-valued  map  from  X  to  Y  with  closed  convex  graph.  Then  if  we  take 
PA  £  DF(xi,yi> (qi>  (i=l,2),  we  have 

(17)  <qx  -  q2,  ~  y2>  i  <Pj_  -  P2>  xi  -  x2>  .  A 

Proof: 


It  is  left  as  an  exercise. 


7 .  Conjugate  functions  of  set-valued  maps  with  closed  convex  graph 

We  shall  characterize  F  by  its  "conjugate  function"  defined  on 


X  »  Y  in  the 


following  way. 

Definition  1 

*  *  * 

We  shall  say  that  the  function  f  from  X  x  Y  to  defined  by 

(1)  f  (p,q)  =  sup  (<p»x>  -  <q,y>)  *• 

(x,y) egraph(F) 

is  the  conjugate  function  of  F. 

* 

In  other  words,  f  (p,q)  =  °graph(p)  <P<_cl)  is,  UP  to  a  minus  sign,  the  support  function 

of  the  graph.  So,  it  is  convex,  lower  semicontinuous  and  positively  homogeneous.  Hence 

*  *  » 

y  e  F(x)  if  and  only  if  VpeX.VqeY,  <p,x>  -  (q,y>  £  f  (p,q)  . 

Proposition  1 

Let  F  be  a  set-valued  map  with  closed  convex  graph.  The  following  statements  are  equi¬ 
valent 

a) .  P0  *  DFlx^yg)*^) 

b) .  <p0,xo>  =  <q0,y0>  +  f*(p0,q0)  .  * 

Proof : 

Statement  b)  is  clearly  equivalent  to  statement  b)  of  proposition  6.4. 

* 

Since  f  (p,q)  =  sup  [ <p,x)  -  (-o(F(x) ,-q) ]  where  o(F(x),q)  =  sup  (p,y>  is  the 
xeX  ycF(x) 

* 

support  function  of  F(x),  p  -*■  f  (p,q)  is  the  conjugate  function  of  x  ►*  -o(F(x),-q).  The 
latter  is  a  convex  function  (for  the  graph  of  F  is  convex)  and  is  lower  semicontinuous  when¬ 
ever  F  is  an  upper  hemicontinuous  set-valued  map.  In  this  case,  it  is  equal  to  its 
biconjugate. 

Proposition  2 

If  F  is  an  upper  hemicontinuous  map  from  X  to  Y  with  convex  graph,  we  can  write 

(2)  c(F(x),q)  =  inf  [f  (p,-q)  -  <p,x)j  .  * 

* 

peX 


Proposition  3 


If  G  is  a  convex  process  from  X  to  Y,  its  conjugate  function  is  the  indicator  of 
★ 

the  graph  G  : 

*  f  0  if  p  e  G  (q) 

(3)  g  (p,q)  =  <  * 

U*  if  p  I  G  (ql  .  * 

Proof :  It  is  left  as  an  exercise.  ■ 

Let  and  F^  be  two  set-valued  maps  with  closed  convex  graph.  We  consider  the  sum 

F  =  F^  +  F2>  defined  by  F(x)  =  F^(x)  +  F2<x).  Its  graph  is  obviously  convex,  but  not 
necessarily  closed.  There  are  several  instances  when  this  is  the  case.  Let  us  mention  for 
instance  the  following  one: 

Lemma  1 


Let  us  assume  that  F^  has  a  weakly  closed  graph  and  that  F.,  is  upper  hemicontinuous 
with  weakly  compact  convex  images.  Then  the  graph  of  F^  +  F2  is  also  closed.  * 

Proof: 

Let  us  consider  a  sequence  of  elements  (x  ,y,  +  y.  )  e  graph (F, +F_)  converging  to 

n  m  zn  l  z 

* 

(x,z).  Since  F2  is  upper  hemicontinuous,  we  can  associate  with  any  p  e  Y  and  e  >  0 

an  integer  N(e)  such  that  o(F,(x  ) ,-p)  <  o(F_(x) ,-p)  +  e/2  and  <p,y,  +  y_  >  < 

z  n  z  in  z  n  — 

<p,z>+t/2  when  n>  N (e )  .  Therefore,  <p,y,  >  <  <p,y,  +  y.  >  +  <-p,y„  )  "* 

in  —  m  zt\  zn  — 

<p,z>  +  o(F2(x),-p)  +  e  when  n>_N(e).  Since  F2<x)  is  weakly  compact,  the  right-hand 
side  of  the  latter  inequality  is  finite  and  consequently, 


V  p  £  Y*, 


sup  (p,y 
n>0 


In 


>  <  ■*“  . 


By  the  uniform  boundedness  theorem  (see  for  instance  Aubin  [2] ,  chap.  4,  1,  p.73) ,  the 

sequence  of  elements  y  is  relatively  weakly  compact.  So,  subsequences  of  elements 
(xn,yln>  and  (xn>y2n*  converge  to  elements  (jt .y^)  and  (x,y2>  .  Since  the  graphs  are 
weakly  closed  (the  one  of  F^  by  assumption,  the  one  of  F2  since  it  is  upper  hemicontinuous) , 
we  infer  that  y^.  e  F1<x),  y2  e  F2<x)  and  z  «  yx  +  y2  «  ^  +  Fj) (x) .  " 
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Remark: 


The  graph  of  F^  is  weakly  closed  whenever  it  is  convex  and  (strongly)  closed.  ■ 
It  is  clear  that 

(4)  (fx  +  f2)  <px  +  P2,q)  i  f1<P1#q)  +  f2(p2.q>  • 

He  shall  deduce  from  a  minimax  theorem  that  equality  holds  under  reasonable  assumptions. 
Theorem  1 

Let  and  F2  be  two  set-valued  maps  with  closed  convex  graph  from  X  to  Y.  We 

assume  that 

(5)  0  e  Int(Dom  F^  -  Dorn  F^) 
and  that  F^  is  upper  hemicontinuous . 

Then,  if  (f^  +  f^)  (Pq'^q)  is  finite,  we  can  write 

<£1  +  f2)*(p0'q0)  “  fl(pl'V  +  f2<p2'q0)  With  P0  =  P1  +  P2  *  * 


Pq  and  such  that 

<f!  +  f2>*<P0'<J0)  ”  s“p  i<p0.x>  -  (q0-yj>  -  <q0*y2>)  <  +~ 

xeX 

yieFi(x)  (1-1,2) 

is  finite. 

Since  F^  is  upper  hemicontinuous,  x  ►*  -o (F^ (x) ,-qQ)  is  convex  and  lower  semicontinuous 

* 

and  hence,  is  the  conjugate  function  of  p  ►*  f^p.qg).  (See  Proposition  2). 

Let  us  set  F^  =  graph (FJ  (i-1,2)  and 

<8>  ^(P(x,y2)  *  F1<p»q0>  *  <p.*>  +  <p0'x>  _  <vy2>  * 

So,  we  can  write 

(9)  <f,  +  f,>  "  8UP  inf  *<P>x»y5)  . 

(x,y2)«F2  pcDomfj^ ( •  .q^ 


(6) 

Proof : 

Let 

(7) 
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The  functions 


p>*  ^(p;x,y2)  are  obviously  convex  and  lower  semicontinuous  and 
(x,y2)  -*■  ^(p;x,y2>  are  affine  continuous.  In  order  to  apply  the  lopsided  minimax  theorem  of 
Aubin  [3],  theorem  13.1.2,  we  have  to  prove  that 


(10) 


{ay  >  0  such  that,  V  v  e  yB,  a(x,y  )  e  F  such  that 

a  =  sup  [<p,v>  -  ^(p;x,y2> 1  is  finite. 

peDomf^(*  ,  q^) 


This  is  the  case,  by  assumption  (5) :  Let  y  >  0  such  that  yB  c  Dorn  F2  -  Dorn  ,  so  there 
exists  x  e  Dom  F2  such  that  v  +  x  e  Dom  F^ .  We  choose  y2  £  F2(x) . 

* 

Hence,  since  -c (F^( • ) ,-qQ)  is  the  conjugate  function  of  f  we  check  that 


(11) 


a  =  -ofF^x+v)  .qg)  -  <pQ,x>  +  (q^y^ 


* 

is  thus  finite.  Hence,  there  exists  c  Dom  such  that 


(fx  +  f2>  <Po,qo)  =  sup  ^(p«x'y2> 

(x,y2)eF2 

=  fl(Pl'V  +  SUp  t<p0  “  P1'X>  ”  <qo'y2)J 

(x,y2) 

=  f*(Pl.q0)  +  f2(P0  -  Pl,q0)  . 


Corollary  1 

Let  and  G2  be  two  convex  processes  from  X  to  Y.  If  G^  is  upper  hemicontinuous 

and  if  0  e  Int(Dom  G1  -  Dom  G^) ,  then 


(G1  +  V 


G1  +G2 


A 


Proof : 

* 

By  Theorem  1,  when  p  €  (G^  +  G2)  ^  '  we  c^n  assoc^ate  P^  and  P2  such  that 

*  *  * 

p  =  pi  +  p2  and  <gx  +  g2>  (p,q)  =  g-^Pj^q)  +  g2(p2,q). 

* 

Each  term  of  the  above  equality  can  be  either  0  or  ».  Since  p  £  (G^  +  G (q) ,  they 

*  * 

are  all  equal  to  0.  But  to  say  that  g^tp^q)  =  0  means  that  p^  £  G^  (q)  ( i=l ,  2)  .  Hence 
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(G^  +  G2)*(q)  c  G*(q)  +  G*(q).  The  converse  inclusion  being  obvious,  equality 

(G1  +  G2)*(q)  =  Gl(q)  +  G2<q)  ensues‘ 

Let  F  be  a  set-valued  map  from  X  to  Y  with  closed  convex  graph  and 

We  shall  compute  the  conjugate  function  of  the  set-valued  map  G  =  FA  from  Z 

*  * 

always  obtain  the  inequality:  if  €  Y  and  Pq  €  Z  ,  then 

h  It  It  * 

(12)  V  p  e  X  such  that  A  p  =  pQ,  g  (Pg.qg)  £  f  <P«qg>  • 

Under  reasonable  assumptions,  we  shall  prove  that  equality  holds  for  some  p 
A*p  =  P0. 

Theorem  2 

Let  F 
A  £  £(Z,Y)  . 

(13) 

Let  G  4  FA 

(14) 

Remark 

Note  that  assumption  (13)  is  satisfied  whenever  A  is  surjective  or 
Im  A  n  Int  Dorn  F  ?  (f . 

Proof : 

Since  F  is  upper  hemicontinuous ,  Proposition  2  implies  that 

* 

o(F(Az),-qQ)  =  inf  [f  (P#qg)  "  <p,Az>]  .  Hence 
p£X 

g*(p0.q0>  4  sup  [<pq,z>  -  <qg.y>i 

Z€Z 

yeF  (Az) 

=  sup[(p  ,z>  +  q(F(Az) ,-qg) J 
zeZ 


be  an  upper  hemicontinuous  set-valued  map  with  convex  graph  from 
We  posit  the  following  condition 

0  £  Int(Im  A  -  Dorn  F) 

and  q0  £  X*,  pQ  £  Z*  such  that  g*(Pg,qg)  is  finite.  Then 

_  *  it  _  *  *  — 

3p  £  X  such  that  A  p  =  pQ  and  g  (Pg,qg)  =  f  (P,qg) 


A  £  £<Z,Y) . 
to  Y .  We 


satisfying 


X  to  Y  and 
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The  function  <f  defined  on  Dom  f  (’.q^)  «  Z  by 


(15) 


*(p.z)  =  f  (p.qg)  +  <P0_A  P'z> 


is  convex  and  lower  semicontinuous  with  respect  to  p  and  affine  and  continuous  with  respect 
to  z.  By  assumption  (13) ,  there  exists  y  >  0  such  that,  V  v  £  yB,  there  exists  z  c  Z 
satisfying  v  +  Az  €  Dom  F.  Consequently, 

a  =  sup  [(P,v>  -  ^(p,z)l 

(16)  ^  peDom  f * ( • ,qQ) 

=  -o(F(v+Az) ,-p)  -  (Pg.z) 


if  finite.  Therefore,  we  can  apply  the  minimax  theorem  of  Aubin  [3),  (theorem  13.1.2):  There 
_  * 

exists  p  c  X  such  that 

*  *_  *  - 

g  =  SUP  f(Pg-A  p,z>  +  f  (P'<lo,) 

zeZ 

*  -  *- 

=  f  (p-qg)  Where  pQ  =  A  p  .  ■ 


Corollary  2 

Let  F  be  an  upper  hemicontinuous  convex  process  from  X  to  Y  and  A  £  f(Z,Y) .  We 
posit  the  following  condition 

(17)  0  £  Int(Im  A  -  Dom  F) 

Then  the  formula 

(18)  (FA)*  =  A*F* 

holds  true .  * 

Proof : 

*  *  * 

The  inclusion  A  F  c  (fa)  is  obvious.  For  proving  the  opposite  inclusion,  we  set 
* 

G  =  FA  and  we  take  pQ  c  G  (qQ) .  Since  G  is  a  convex  process,  this  means  that 

g*(po,qo)  =  0.  By  theorem  2,  whose  assumptions  are  satisfied,  we  deduce  that  there  exists  p 

*  _  i  h  m.  *  •  —  * 

such  that  A  p  =  pQ  and  g  (P0,qQ)  =  f  (P,qg) •  Hence  f  (p,qg)  ■  0,  i.e.,  p  £  F  (qg) . 

*  -  *  * 

Hence  pQ  =  A  p  £  A  F  (qQ) .  " 
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8.  Calculus  on  derivatives  and  codifferentials 


We  begin  by  proving  the  "chain  rule". 

Theorem  1 

Let  F  be  a  set-valued  map  from  X  to  Y  with  closed  convex  graph  and  A  e  £(Z,Y) . 
We  assume  that 

(1)  0  £  Int(Im  A  -  Dom  F)  . 


Then  the  following  chain  rule  formulas  hold 

{i)  D(FA) (z  ,y  )  =  DF(Az  ,y  )A 

ii)  D(FA) (Zq.Yq)*  -  A*DF(Az0,y0)*  . 


Proof: 

We  know  that  the  graph  G  of  G  =  FA,  which  is  closed  and  convex,  is  equal  to 
(A  »  1)  1F,  where  F  is  the  graph  of  F.  The  assumption  0  £  Int(Im  A  -  Dom  F)  implies 
obviously  that,  in  X  x  Y,  0  £  Int(Ii(A  *  1)  -  F) .  So,  by  theorem  5.1,  we  know  that 
Tg(z0,y0)  =  (A  x  l)-1Tp(Az0,yQ)  and,  by  proposition  5.4,  that  ng<z0>Y0>  =  (A  x  l)Nj;(Az0,y0)  . 
This  implies  formulas  (2)  i)  and  ii) .  Note  that  assumption  (1)  is  always  satisfied  when  A 
is  surjective  or  when  Im  A  n  Int  Dom  F  ?  9.  ■ 

Let  us  still  consider  a  set-valued  map  F  with  closed  convex  graph  from  X  to  Y  and 
A  £  £(Y,Z).  The  graph  of  the  set-valued  map  AF  from  X  to  Z  is  still  convex,  but  not 
necessarily  closed.  We  shall  denote  by  AF  the  set-valued  map  whose  graph  is  the  closure  of 
the  graph  of  AF. 

Theorem  2 

Let  F  be  a  set-valued  map  from  X  to  Y  with  closed  convex  graph  and  A  £  JC(Y,Z). 

D(AF) (x0,Ay0)  -A.  DF{xQ,y0) 

D(AF)  <x0,Ay0)*  -  DF(x0,y0)V  .  * 

of  G  *  AF  is  (1  x  a)F,  where  F  is  the  graph  F. 


(3) 


i) 

ii) 


Proof: 


We  note  that  the  graph  G 
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We  deduce  from  Proposition  5.3  that  T-(xQ,Ay())  =  cMl  *  A)Tp(x0,yQ)  and  that 

6 

* 

N  (x0,AyQ)  =  (1  x  A)  Np(xQ,y0).  So  formulas  (3)  i)  and  ii)  ensue. 


We  now  compute  the  derivative  of  an  intersection. 

Proposition  1 

Let  us  consider  n  +  1  set-valued  maps  F^  with  closed  convex  graph  and  let  F  be  the 
set-valued  map  from  X  to  Y  defined  by 

n 

(4)  F (x)  ±  n  p.(x)  . 

i=0  1 


Let  I(xQ,y0)  denote  the  set  of  indexes  i  such  that  (xQ,y0)  e  Bound (graph (F^) ) .  If  we 
assume  that 


(5) 

then. 


such  that,  V  i-l,...,n,  Vue  YB,  a  xQ  e  Dom  FQ 
e  F(xq)  such  that  yQ  e  f^xq  +  ui*  "  vi(i=l, . . .  ,n) 


(6)  DF(x0,y0)  =  n  . 

ieJ(x0'y0) 

Proof : 


The  graph  F  of  F  is  the  intersection  of  the  n  +  1  graphs  Fi  of  the  maps  F^. 

It  is  easy  to  check  that  assumption  (5)  implies  that  for  any  i-l,...,n,  for  any 

<Ui'Vi>  e  Y(B  *  B*  '  there  exists  (x0,y0)  e  FQ  such  that  (xQ+  ^ ,  yQ+  v^)  e  Fi .  Thus,  by 

n 

Proposition  5.5,  T^tx  ,y  )  «  n  (x  ,y  )  -  n  Tp  <x0,yQ)  (for  Tp  (xQ,yQ)  =  X  *  Y 

i«0  i  ieJ(x0,y0)  i  i 

when  i  {  J(x  ,y  ).).  This  means  that  for  all  u  e  X,  DF(xQ,y0) (uQ)  =  n  DFi(xO’yo'‘ 

i€j(x0'y0) 

■ 

For  a  calculus  on  set-valued  maps  to  be  useful,  we  need  a  formula  on  the  derivative  of  the 
sum  F  of  two  set-valued  maps  F^  and  F 2,  defined  by 


F (x)  =  F^ (x)  +  F2(x) 
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We  begin  by  noticing  that  the  graph  of  F  is  not  necessarily  closed  when  the  graphs  of 
( i=l ,2)  are  closed.  We  recall  that  it  is  the  case,  though,  when  one  of  the  set-valued 
maps  is  upper  hemicontinuous  with  compact  convex  images. 

There  are  instances  when  we  can  compare  the  derivatives  of  F^  +  F and  of  F^  and  F 2 
For  example,  it  is  easy  to  show  that  if  the  maps  F^  are  locally  Lipschitzean  with  convex 
graph,  then  D(F^  +  F2> (x0,  yx  +  y2>  c  DF^Xg.y^  +  DF2(xQ,y2). 

The  situation  is  much  better  for  codifferentials:  we  always  obtain  the  inclusion 

<7>  DF1(x0,y1)*  +  DF2(xQ,y2)*  c  d(F1  +  F2)*(xQ,  yx  +  y2>  . 

*  * 

Indeed,  if  pi  e  DF^x^yJ  (q)  ,  then  equalities  <pi,xQ>  =  fi<pi,q)  +  <q,yi  >  (i=l,2)  imply 
inequality  <px  +  p2>  xQ  >  =  f^p^q)  +  f2<P2,q)  +  <q,  yx  +  y2  >  >  (fj  +  fj)  <PX  +  Pj,  q)  + 

<q,  y^  +  y2>.  Since  the  other  inequality  is  always  true,  we  infer  that  <p^  +  P2'  x0 >  = 

<fl  +  f2*  <P1  +  P2'  q)  +  <q'  yl  +  y2>(  i,e>'  that  P1  +  p2  £  D<F1  +  F2)  <X0’  Y1  +  V2) ' 


We  now  state  that  under  reasonable  assumptions  the  codifferential  of  the  sum  of  two 
set-valued  maps  F^(i=l,2)  is  equal  to  the  sum  of  the  codifferentials. 

Theorem  3 

Let  F^  and  F2  be  two  set-valued  maps  with  closed  convex  graph  from  X  to  Y.  We 
assume  that 

(8)  0  e  InttDom  F^  -  Dorn  F^) 

and  that  F^  is  upper  hemicontinuous  with  (weakly)  compact  values.  Then,  for  all 
xQ  €  Dorn  Fx  n  Dorn  Fj,  yx  c  F^x^,  y2  £  F2(X0)*  We  have! 

(9)  D(F1  +  F2) (x0,  Vl  +  y2)*  -  DF1(x0,y1)*  +  DF2(x0,y2)*  .  a 

This  formula  justifies  the  usefulness  of  the  concept  of  codifferential. 
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Proof  of  Theorem  3 


*  * 

Assume  that  pQ  «  D(FX  +  F2>  (xQ,  yj^  +  y2>  (q^  .  So,  <P0<*0>  =  x  +  f2>  (Po,qO}  + 

<v  y^  +  y.,).  Theorem  7-l  implies  the  existence  of  p^  such  that 

o  “  (fI(Pl'V  +  <q0’yl>  ‘  <Pl'xo>)  + 

+  <f2(p0  "  Pl'  V  +  <q0'y2>  ’  <P0  '  pl*  X0))  • 

Since  the  two  terms  of  this  sum  are  nonnegative,  then  each  of  these  two  terms  is  equal 

*  * 

to  zero.  This  means  that  Pj^  e  DF^Xg.y^  (q^  and  P0  “  Pj  €  DF2*xo'y2*  •  So 

D(F1  +  V  (x0'  yi  +  y2,*(<J0)  C  DFl(X0'yl)*(qO)  +  DF2(X0'y2)*(q0)‘ 

Since  the  other  inclusion  (7)  is  true,  equality  (9)  holds.  • 

We  state  now  two  consequences.  Let  us  recall  that  we  denote  by  the  indicator  of  K, 

which  is  the  set  valued  map  from  X  to  Y  defined  by 

f {0}  if  x  e  K 

(10)  *  <x)  -  < 

0  if  x  4  K  . 

We  recall  that 

di)  d*k<x)  =  *Vx)  . 

The  restriction  of  a  set-valued  map  F  from  X  to  Y  is  the  sum  F  + 

We  can  compute  the  derivative  of  the  restriction  of  a  set-valued  map  with  closed  convex 
graph. 

Proposition  2 

Let  F  be  a  set-valued  map  from  X  to  Y  with  closed  convex  graph  and  p  be  its 

restriction  to  the  closed  convex  subset  K  c  x.  If 

(12)  0  e  Int(Dom  F  -  K) 

then  for  all  x  e  K  and  y  e  F(x), 

i)  D(F  +  1^K)  (x,y)  (q)  =  DF(x,y)  (q)  +  NR(x) 

U3)\ 

iii)  D(F  +  (x,y)  =  DF(x,y)  +  ij/_  ,  .  is  the  restriction  of  DF(x,y)  to  T  (x) 

'  K  TJX]  *■  4 
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The  indicator  i(iK  is  an  upper  hemicontinuous  set-valued  map  from  X  to  Y  whose  graph 

K  x  {0}  is  a  closed  convex  subset.  The  normal  cone  to  K  x  {0}  is  NR(x)  x  Y  •  Then,  for 

*  * 

any  q  e  Y  ,  p  c  Di^lx.O)  (q)  if  and  only  if  pc  NK<x)  • 


Proof: 

We  consider  the  constant  set-valued  map  G  :  x  •*  P  whose  graph  is  X  x  p.  Its  normal 
cone  to  (x,0)  is  {0}  *  P  .  Hence  DG(x,0)*  is  the  indicator  of  the  positive  polar  cone 
P+.  Since  G  is  upper  hemicontinuous  and  Dorn  G  =  X,  Theorem  3  implies  formula  (14)  .  ■ 


9.  Upper  derivatives  and  codifferentials  of  convex  operators 


Single  valued  maps  whose  graphs  are  convex  (resp.  closed  and  convex)  are  the  affine  opera¬ 
tors  (resp.  continuous  and  affine) .  The  latter  statement  follows  from  the  closed  graph  theorem 

(see  for  instance  Aubin  12],  chap.  4,  §3,  p.  83). 

We  shall  investigate  now  the  properties  of  P  -  convex  and  P  -  lower  semicontinuous 
operators . 

Definition  1 

Let  P  be  a  closed  convex  cone  of  Y  and  A  be  a  single  valued  map  from  a  convex  sub¬ 
set  K  to  Y,  which  we  extend  to  X  by  setting  A(x)  =  ft  when  x  ^  K. 

n 

We  say  that  A  is  P  -  convex  if,  for  all  convex  combinations  J  X  x.  of  elements  of 

i=l  1 

X  we  have 

n 

(1)  l  X1A(x.)  c  A^xSux.))  +  P  . 

i=l  1 

We  say  that  A  is  P  -  lower  semicontinuous  (in  short,  P  -  t.s.c.)  if 

(2)  V  p  £  Y  ,  V  E  >  0,  3N(xq)  such  that  A(x)  £  A(xQ)  +  P  +  B(p,e)  .  4 

Let  us  set  A+(x)  =  A(x)  +  P  when  x  £  K  and  A+(x)  =  0  when  x  ^  K.  To  say  that  A  is 
P  -  convex  amounts  to  saying  that  the  graph  of  F  is  convex  and  to  say  that  A  is  P  -  t.s.c. 
amount  to  saying  that  the  set-valued  map  A+  is  upper  hemicontinuous  (and  thus,  has  a  closed 
graph) .  ■ 

Definition  2 

We  shall  say  that  the  convex  process  D+A(x)  defined  by 

(3)  D+A(x)(u)  iDA+(x,A(x))(u) 

is  the  upper  contingent  derivative  of  A  at  x  and  that  its  transpose 

(4)  D+A(x)*(q)  i  DA+(x,A(x))*(q) 
is  the  upper  codifferential  of  A  at  x. 

We  shall  say  that  the  conjugate  function  of  the  set-valued  map  A+  is,  more  simply,  the 
conjugate  function  of  the  P  -  convex  and  P  -  i.s.c.  operator  A.  4 
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The  conjugate  function  of  a  P  —  convex  and  P  -  i.s.c.  operator  A  is  egual  to 


when 


when 


The  domains  of  the  upper  codifferentials  D  A(x)  are  contained  in  P 


the  following  statements  are  equivalent 


This  follows  from  the  fact  that  the  support  function  o( P,q)  =  0  when  q  e  -P  and 


when 


The  characterization  of  D  A(x)  follows  from  Propositions  6.4  and  7.7  by  using  the  same 


remark 


We  translate  now  the  properties  of  the  set-valued  map  A  in  terms  of  the  P  -  i.s.c 


and  convex  operator  A 


Theorem  1 


x  e  K,  we  have 


b)  Xq  minimizes  A  on  K,  in  the  sense  that  A(x)  -  A(Xg)  e  P  for  all  x  £  K,  if 


and  only  if 


V  u  £  Dom  D+A(xQ),  D+A(xq)  (u)  £  P 


c)  If  B  £  £(Z,X)  and  if 


0  £  Int(Im(B)  -  Dom  A) 


i)  D+(AB)(zq)  =  (D+A)(Bzq)B 


ii)  D+(AB)  (zQ)  =  B  D+A(BzQ) 


d)  If  Ax  and  A2  are  two  P  -  convex  and  P  -  f.s.c.  operators  satisfying 


0  £  Int(Dom  Aj^  -  Dom  A^) 


D+(A1  +  A2> (x)  =  D+Ai<x>  +  D+A2(x) 


e)  Let  us  assume  that 


0  e  Int(K  -  Dom  A) 


If  Ar  denotes  the  restriction  of  A  to  K,  we  have 


i)  D+Ar(x)  =  D+A(x)  +  Nr(x) 


ii)  D+ar(x)  is  the  restriction  of  D+A(x)  to  TR(x) 


These  statements  follows  obviously  from  Propositions  6.2,  6.3,  Theorem  8.1,  Proposition  8.1 


Theorem  8.3  and  Proposition  8.2  respectively 


The  transposed  of  the  contingent  derivative  DV+(x,V(x))  is  a  convex  process  from  F 
to  X  ,  whose  domain  is  contained  in  F+  (by  Proposition  9.1)  .  Then,  for  any  q  ^  0  we 
have 

DV+(x,V(x))*(q)  =  q  DV+ (x, V(x) ) * ( 1)  . 

It  is  easy  to  remark  that 

(8)  DV+(x,V(x))*(l)  =  3V(x) 
is  the  subdifferential  of  V  at  x. 

By  Proposition  9.1,  the  conjugate  function  is  infinite  when  q  <  0.  So  we  have,  if 

q  >  0 

v*(po’qo)  =  sup  Kpo'x>  "  qov(x)J  • 

xeK 

We  see  that  for  q^  =  1, 

(9)  v*(pQ,l)  =  V  (pQ) 

where  V  is  the  conjugate  function  in  the  usual  sense.  Therefore,  when  V  is  convex  and 
lower  semicontinuous ,  the  following  statements  are  equivalent: 

a)  pQ  £  3V(xq) 

b)  <P0,x0>  -  V*(pQ)  ♦  V(xQ) 

c)  V  X  £  X,  V(xQ)  -  V(x)  <  <P0,  xQ  -  X) 

d)  V  u  £  X,  (Pq,u)  D+V(xq)  (u)  . 

* 

(The  latter  statement  makes  explicit  the  fact  that  pQ  t  DV+ (x0,V(xQ) )  (1),  i.e.,  the  fact 

that  for  all  u  £  X  and  for  all  v  £  DV+(x0,vQ)  (u)  =  [D+V(xQ)  (u)  ,  »[,  (p,u>  <_  1.  v,  i.e., 

the  fact  that  for  all  u  £  X,  <p,u>  <_  D+V(xQ)  (u)  .) . 

Theorem  9.1  on  P  -  convex  operators  implies  the  following  properties  (see  Rockafellar  (1) 
for  instance) . 
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Theorem  1 


Let  V  be  a  convex  lower  semicontinuous  function  from  X  to  ] -'»,+*]  whose  domain 
nonempty 

a)  for  any  xQ,  x  £  K,  we  have 

(10)  V (x)  -  V(xQ)  >  D+V(xQ) (x  -  xQ) 

b)  xQ  minimizes  V  on  K  if  an  only  if 

(11)  V  u  £  Dom  D+V(xQ),  0  <  D+V(xQ) (u) 

c)  if  B  £  £<Z,X)  and  if 

(12)  0  £  Int(Im(B)  -  Dom  V)  , 


then 


(13) 


(i)  D+(VB)  <zQ) (u)  =  (D+V) (BzQ) (Bu) 
ii)  3 (VB) (zQ)  =  B*3V(Bzq)  . 


d)  If  W  is  another  convex  lower  semicontinuous  function  such  that 


(14) 


0  £  Int(Dom  V  -  Dom  W)  , 


then 


(15) 


3(V+W)(xQ)  =  3V(xq)  +  3W(xQ)  . 


e)  Let  us  assume  that 


(16) 


0  £  Int(K  -  Dom  V) 


If  denotes  the  restriction  of  V  to  K,  we  have 


(17) 


x) (v)  =  D+V(x) (v)  V  v  £  Tr(u) 


^  w 

^  ii)  3Vk<x)  “  3V(X)  +  Nr(x) 


A 


We  mention  also  the  following  statement. 
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Proposition  2 


Let  us  consider  n  convex  lower  semicontinuous  functions  from  X  to  ]  -»,+“>] .  Let 


V  be  defined  by 
(18) 


V(x)  =  max  Vi(x) 
i«l, . . ,n 


J(X) 

=  {i»l, . . 

.  ,n  |  Vi(x) 

«  V(x) }  . 

!  n 

functions 

Vi  are  continuous  at  xQ.  Then 

i) 

DV(x.) (v) 

=  max 

DV. <x.) (v) 

u 

i€J(xQ) 

1  V 

ii) 

3V(x  )  = 

o 

£ 

c 

3V. (xQ))  . 

ieJ(xQ) 

We  see  that  V  (x)  =  r>  v.^(x).  So,  we  apply  Proposition  8.1.  Since  x  e  IntDom  V., 

1=1  1  * 
then  J(xQ)  =  { i«l, . . . ,n  |  (xQ,y0)  €  Bound(graph  Vi+) } .  Also,  since  the  functions  are 

continuous,  there  exists  y  such  that  V^tx^  +  —  ^i^xo^  +  ^  when  u  €  yB(i“l» . . . ,n) .  Set 

yQ  =  V(xQ)  +  2y.  Then,  if  ^  e  yB  and  |vj  <  y ,  we  have  yQ  £  +  <*0  +  ui>  "  Vi  for 

i-l,...,n.  Therefore,  Proposition  8.1  implies  that  D  V(x.) (v)  =  n  D+Vi(x0) <v) •  “ 

ieJ  (xQ) 
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